BRILL-NOETHER THEORY FOR MODULI SPACES OF SHEAVES ON 

ALGEBRAIC VARIETIES 

L. COSTA*, R.M. MIRO-ROIG** 

jC^ , Abstract. Let X be a smooth projective variety of dimension n and let H be an ample 

^\ • line bundle on X. Let Mx,h{t\ ci, ■ • ■ , c^) be the moduli space of if -stable vector bun- 

^SJ \ dies ii^ on AT of rank r and Chern classes Ci{E) — Ci for i — I,--- ,s :— min{r,n}. 

We define the Brill-Noether filtration on Mx,_f/(r;ci, • • ■ ,Cs) as W^^(r;ci,--- ,Cs) = 
{E e Mx.Hir',ci,--- ,Cs)\h°{X,E) > k} and we realize W^{r;ci,- ■ ■ ,Cs) as the Mh 
determinantal variety of a morphism of vector bundles on Mx^nif] ci, • • • ,Cs), provided 
H^{E) = for z > 2 and E £ Mx,H{'r]Ci,- ■ ■ ,Cs)- We also compute the expected 
dimension of W^{r;ci,--- ,Cs)- Very surprisingly we will see that the Brill-Noether 
stratification allow us to compare moduli spaces of vector bundles on Hirzebruch sur- 
\^ • faces stables with respect to different polarizations. We will also study the Brill-Noether 

.^ I loci of the moduli space of instanton bundles and we will see that they have the expected 

• ' dimension. 
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1. Introduction 

r\ \ Let X be a smooth projective variety of dimension n over an algebraically closed field 

c^ ■ i^ of characteristic and let Mx,H{r', Ci,- ■ ■ , Cg) be the moduli space of rank r, vector 

bundles ii^ on X stable with respect to an ample line bundle H and with fixed Chern 
classes Ci{E) = q for i = 1, ■ ■ ■ , s := min{r,n}. Moduli spaces of stable vector bundles 
were constructed in the 1970's by Maruyama and since then they have been extensively 
studied from the point of view of algebraic geometry, of topology and of differential 
geometry; giving very pleasant connections between these areas. Unfortunately, except 
in the classical case of vector bundles on curves, relatively little is known about their 
geometry in terms of the existence and structure of their subvarieties. 
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In the case of line bundles on smooth projective curves C of genus g, where the moduli 
spaces Pic'^{C) of degree d line bundles are all isomorphic to the Jacobian, Brill-Noether 
theory has long provided a basic source of geometrical information. The classical theory 
of Brill-Noether has a long history and it is concerned with the subvarieties W^ of Pic'^{C) 
whose line bundles have at least k+1 independent global sections. Basic questions concern- 
ing non-emptiness, connectedness, irreducibility, dimension, singularities, cohomological 
classes etc ... have been answered when the curve C is generic on the moduli space Mg 
of curves of genus g. There are several natural ways to generalize the classical theory of 
Brill-Noether. First, instead of studying line bundles on curves, we can consider vector 
bundles of any rank giving rise to the Brill-Noether loci in the moduli space of stable 
rank r vector bundles on curves studied by Newstead, Teixidor and others. Indeed, dur- 
ing the last two decades, a great amount of job has been made around the Brill-Noether 
stratification of the moduli space of degree d, stable, rank r vector bundles on algebraic 
curves, giving rise to nice and interesting descriptions of these subvarieties. Neverthe- 
less, it should be mentioned that in spite of big efforts, many questions concerning their 
geometry still remain open. Second, instead of studying line bundles on curves, we can 
consider line bundles on varieties of arbitrary dimension and, finally, we can go in both 
directions simultaneously. We can consider a smooth projective variety X of dimension 
n, an ample line bundle H on X, the moduli space Mx,H{r', ci, ■ ■ ■ , Cg) of rank r, if-stable 
vector bundles E on X with fixed Chern classes Ci{E) = cf, 1 < i < min{r, n}, and we can 
study the subschemes in Mx,_H-(r; Ci, ■ ■ ■ , c^) defined by conditions {dim H^ {X , E) > rij}. 
In [TT], Gottsche and Hirschowitz studied the Brill-Noether loci in the moduli space of 
stable vector bundles on P^ and in [15]- [TB], Leyenson studied the Brill-Noether loci in 
the moduli space of stable vector bundles on K3 surfaces. The goal of this paper is to 
introduce a Brill-Noether theory for moduli spaces of rank r, H-sidhle vector bundles on 
algebraic varieties of arbitrary dimension, extending, in particular, all the above results 
to higher dimensional varieties. Once we will have constructed the Brill-Noether stratifi- 
cation in this much more general context, we will address the main problems and we will 
analyze them for several concrete moduli problems. 

Next we outline the structure of this paper. In section 2, we will define the Brill- 
Noether locus W^(r;ci,--- ,Cs) in Mx,ii-(r; Ci, • ■ ■ , c^) as the set of vector bundles in 
Mx,Hij]Ci,- ■ ■ iCg) having at least k independent sections and associated to this lo- 
cus we consider the generalized Brill-Noether number p^(r;ci,--- ,Cs). We prove that 
iy^(r;ci,- ■■ ,Cs) has a natural structure of algebraic variety and that any of its non- 
empty components has dimension > p^(r;ci,--- ,Cs). Therefore, it is natural to ask 
whether the numerical condition p^(r; Ci, ■ ■ ■ , c^) < implies that Wj^{r; Ci, ■ ■ ■ , Cs) is 
empty, and whether /9^(r; ci, ■ ■ ■ , Cs) > implies that Wj^{r; Ci, ■ ■ ■ , Cs) is non-empty of 
dimension /9^(r; ci, ■ ■ ■ , c^). We end the section giving examples of situations where the 
expected dimension p^(r; Ci, ■ ■ ■ , Cs) < and W^{r; Ci, ■ ■ ■ , c^) is non-empty; and exam- 
ples where p^(r; Ci, ■ ■ ■ , c^) > and W^{r; Ci, ■ ■ ■ , c^) is non-empty of dimension strictly 
greater than p%{r:,Ci,--- , c^), in contrast with the classical case. In section 3, we will an- 
alyze how the Brill-Noether stratification will allow us to compare moduli spaces of vector 
bundles on a smooth projective surface stable with respect to different polarizations. It 
turns out that the ample cone of a smooth projective surface X has a chamber structure 
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such that the moduh space Mx,h{i^]Ci,C2) only depends on the chamber of H and the 
problem consists on determining how the moduli space changes when the polarization 
crosses a wall between two chambers (see Definition 13. 2p . Very surprisingly we will realize 
that in many situations, the Brill Noether locus controls these changes. As a by-product 
we will obtain a huge family of examples where the dimension of the Brill-Noether loci 
coincide with the expected one. In the last section, we describe the Brill-Noether loci in 
the moduli space of mathematical instanton bundles. 

Notation: We will work over an algebraically closed field K of characteristic zero. Let 
X be a smooth projective variety of dimension n and let ii^ be a rank r vector bundle on 
X with Chern classes Ci{E) = Ci, 1 < i < s := min{r,n}. Set xi^'iCi,--- , c^) := x{E). 
We will write W{E) (resp. exf{E,F)) to denote the dimension of the i-th cohomology 
group H^{X,E) = W{E) (resp. i-th Ext group Ext^{E,F)) as a /^-vector space. The 
sheaf Kx will denote the canonical sheaf on X. 

2. Construction of the Brill-Noether Loci 

The goal of this section is to prove the existence of a Brill-Noether type stratification 
on the moduli space of stable vector bundles on smooth projective varieties analogous 
to the classical stratification of the Picard variety Pid^^C) of degree d line bundles on a 
smooth projective curve C. 

Let us start fixing the notation and some basic definitions. We consider X an n- 
dimensional smooth projective variety, H an ample divisor on X, r > 2 an integer and 
Ci G H'^^X, Z) for 2 = 1, ■ ■ ■ , s = min{r, n}. We denote by Mh = Mx,h{'>^', Ci, ■ ■ ■ , c^) 
the moduli space of rank r, vector bundles E on X, with fixed Chern classes Ci{E) = Ci 
for i = 1,- ■ ■ ,s, and if -stable according to the following definition due to Mumford and 
Takemoto. 

Definition 2.1. Let H be an ample line bundle on a smooth projective n dimensional 
variety X. For a torsion free sheaf F on X we set 

,4F) = ,MF) :- '''<''"'"" 



rk{F) 

The sheaf F is said to be H-semistahle if 

^iH{E) < finiE) 

for all non-zero subsheaves E G F with rk{E) < rk{F); if strict inequality holds then F 
is H-stable. Notice that for rank r vector bundles F on X with {ci{F) H"'~^ , r) = 1, the 
concepts of if-stability and ilf-semistability coincide. 

Remark 2.2. The definition of stability depends on the choice of the ample line bundle 
H. The changes of the moduli space that occur when the line bundle H varies have 
been studied by several people in great detail and reveals interesting phenomena (see for 
instance [19]; [6]; [7]; [8]; [9] and references therein). In section 3, we will see how the 
Brill-Noether loci allow us to study these changes. 
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The main goal of this section is to construct a subvariety W^{r; ci, • • • , c^) of Mh whose 
support is the set of rank r, iJ-stable vector bundles E on X with Chern classes q such 
that hP{E) > k. In other words, we are going to construct a variety 

Wj^{r;ci,--- ,Cs) 

such that 

Supp{W!^{r- ci, ■ ■ ■ , c,)) = {Ee MH\h\E) > k}. 

To achieve our propose, we first need to recall the definition of A;-th determinantal 
variety. Let (p : E ^ F he a morphism between locally free sheaves of ranks e, / over 
an algebraic variety X. Upon choosing local trivializations of E and F over an open set 
U G X, the morphism is represented by an e x / matrix A of holomorphic functions. 
We denote by Uk the subset of U whose ideal is generated by the (/c + 1) x (/c + 1) minors 
of A. It is easy to see that Uk does not depend on the choice of the trivialization, and 
therefore there is a well-defined subvariety Xfe(0) of X such that 

Xfc(0) nu = Uk 

for every open set U G X. The variety Xfc(0) is called the k-th determinantal variety 
or the k-th degeneracy locus of 0; it is supported on the set 

{p e X|rA;(0p) < k} 

and it is clear from the definition that Xk{(f)) has codimension at most {e — k){f — k) when 
it is non-empty and 

Xfc(0) C Stng{Xk+M) 

whenever XkJri{4>) 7^ X. 

We are now ready to define the Brill-Noether filtration of Mx,h{i^', Ci, ■ ■ ■ , c^) and to 
give a formula for the expected dimension of the Brill-Noether locus. 

Theorem 2.3. Let X be a smooth projective variety of dimension n and consider a 
moduli space Mh = Mx,h{j'] ci, ■ ■ ■ , Cs) of rank r , H-stahle vector bundles E on X with 
fixed Chern classes Ci{E) = ci. Assume that for any E G Mh, H'^{E) = for i > 2. 
Then, for any k > 0, there exists a determinantal variety Wj^{r; Ci, ■ ■ ■ , c^) such that 

Supp{W!^{r; ci, ■ ■ ■ , Cs)) = {E G Mnlh^E) > k}. 

Moreover, each non-empty irreducible component of W^{r;ci,- ■ ■ ,Cs) has dimension at 
least 

dim{MH) - k{k - x{r; Ci, ■ ■ ■ , c^)), 

and 

W^+\r; ci, ■ ■ ■ , Cs) G Sing{Wl^{r; Ci, • ■ ■ , c,)) 

whenever WH{r;ci,-- ■ ,Cs) ^ Mx,H{r;ci,- ■■ ,Cs). 
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Proof. First of all assume that Mh is a fine moduli space. Let W — > X x Mh be a universal 
family such that for any t G Mh, l^\xx{t} = Et is an if -stable rank r vector bundle on 
X with Chern classes Ci{Et) = Ci. Let D be an effective divisor on X such that for any 

(2.1) h\Et{D))=x{Et{D)), W{Et{D)) = 0, z > 1. 

Consider V = D x Mh the corresponding product divisor on X x Mh and denote by 

u : X X Mh ^ Mh 

the natural projection. It follows from (12. ip and the base change theorem that vJJ{T>) is 
a locally free sheaf of rank x{Et{D)) on Mh and 

RuM{V) =0, z > 0. 

Therefore, applying the functor v^, to the short exact sequence 

^ W ^ U{V) -^ U{V)/U -^ 

we get the following exact sequence 

^ z/,W -^ vM{V)^^v,{U{V)/U) -^ R^vM -^ 0. 

The map 7 is a morphism between locally free sheaves on Mh of rank x{Et{D)) and 
x{Et{D)) — x{E) respectively and the {x{Et{D)) — k)-th determinantal variety 

W!^{r;cu--- ,Cs)cMh 

associated to it has support 

{Et e Mh\ rank 7s, < x{Et{D)) - k} 

i.e. Wnir-jCi,--- , c^) is the locus where the fiber of R^uJA has dimension at least 
{x{Et{D)) - x{Et)) - {x{Et{D)) -k) = k- x{Et). For any Et G Mh the assumption 
h'{Et) =0,i>2, implies 

h\Et) = h%Et)-x{Et). 
Thus, 

Supp{W^{r; ci, ■ ■ ■ , c,)) = {E e Mnlh^E) > k - x{E)} 

= {E e MH\h^{E) > k}. 

Using the language of Fitting ideals, we have that Wnij; ci, ■ ■ ■ , Cg) is the subvariety of 
Mh defined by the {k — x(-Et))th Fitting ideal of R^uJA. Moreover, it can also be seen 
that Wj^{r; Ci, ■ ■ ■ , c^) represents the functor 

C equivalence classes of families J-" on S x Mh — ^Mh 
S" ^ < of if -stable rank r vector bundles E on S with Ci{E) = Ci 
^ such that the Fitting rank of R^u^J-' is at least {k — x{E)) 

Finally, since iy^(r; Ci, ■ ■ ■ , c^) is a {x{Et{D)) — fc)-determinantal variety associated to a 
morphism between locally free sheaves of rank x{Et{D)) and x{Et{D)) —x{E) respectively, 
any of its non-empty irreducible components has dimension greater or equal to dini[MH) — 
k{k - x{E)) and 

W^H^\r- ci, ■ ■ ■ , Cs) C Sing{W^{r- Ci, ■ ■ ■ , c,)) 
whenever iy^(r; Ci, ■ ■ ■ , c^) 7^ Mx,H{r; Ci, ■ ■ ■ , c^). 
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If Mh is not a fine moduli space, it is also possible to carry out the construction of 
the Brill-Noether locus using only the local existence of a universal sheaf on Mh- Indeed, 
we carry out the constructions locally, we show the independence of the choice of the 
locally universal sheaf and we conclude that the construction glue as a global algebraic 
object. D 

Remark 2.4. (1) The cohomological assumptions in Theorem 12.31 are natural if we want 
to have a filtration of the moduli space Mh by the subvarieties PV^(r; ci, ■ ■ ■ , Cs). Indeed, 
if X is an n-dimensional projective variety, then any vector bundle E ow X has n + 1 
cohomological groups whose dimensions are related by Riemann-Roch theorem and one 
is forced to look for a multigraded filtration of the moduli space Mh by means of the 
sets {E G MH\h^{E) > ki}. Under the assumptions of Theorem 12. 3^ h^{E) = for 
i > 2 and for any E G Mh, the only non-vanishing cohomology groups are H^{E) and 
H^{E) and their dimensions are subject to one relation given by Riemann-Roch theorem: 
diva. H^ [E) — dmy H^ [E) = x{E) = x(^; Ci, ■ ■ ■ , Cg). Hence, it makes sense to consider only 
the filtration of the moduli space Mh by the dimension of the space of global sections. 

(2) We want to point out that there exists plenty of vector bundles satisfying the 
cohomological conditions of Theorem 12. 3[ For instance, instanton bundles on p^n+i^ 
Schwarzenberger bundles on P", Steiner bundles on P", Steiner and Spinor bundles on a 
hyperquadric Qn C P"+^, etc. 

Definition 2.5. The variety Wl^{r; ci, ■ ■ ■ , c^) is called the fc-Brill-Noether locus of 
the moduli space Mh (or simply Brill-Noether locus if there is no confusion) and 

p^(r;ci,--- ,Cs) := dimM^ - k{k - x{r; Ci, ■ ■ ■ ,c^)) 

is called the generalized Brill-Noether number. 

By Theorem 12. 3[ the Brill-Noether locus Wj^{r; ci, ■ ■ ■ , c^) has dimension greater or 
equal to p^(?";ci,--- , c^) and the number p^(r;ci,--- ,Cs) is also called the expected 
dimension of the corresponding Brill-Noether locus. Hence, we are led to pose the ques- 
tion whether the dimension of the Brill-Noether locus W^{r; Ci, ■ ■ ■ , c^) and its expected 
dimension coincide provided the Brill-Noether locus Wj^{r; Ci, ■ ■ ■ , c^) is non-empty. 

Notation 2.6. If there is no confusion then, we will simply write W^ and p^ instead of 
Wnir; Ci, • ■ ■ , Cs) and p^(r; Ci, ■ ■ ■ , c^). 

We will say that the Brill-Noether locus is defined in the moduli space Mh whenever 
the assumptions of Theorem 12.31 are satisfied, i.e. for any E G Mh, H^{E) = for i >2. 

Remark 2.7. Notice that when X is a smooth projective curve and we consider the 
moduli space Pic'^{X) of degree d line bundles on X, then we recover the classical Brill- 
Noether loci which have been well known since the last century, and the generalized Brill- 
Noether number is the classical Brill-Noether number p = p{g, r, d) = g — {r + l){g — d+r). 

Corollary 2.8. Let X be a smooth projective surface and let Mh = Mx,H{r', 01,02) be a 
moduli space of rank r, H -stable vector bundles E on X with fixed Chern classes Oi{E) = 
Oi. Assume that oiH > rKxH . Then, for any k > 0, there exists a determinantal variety 
W^{r] 01,02) such that 

SuppiW^ir; 01,02)) = {Ee Mnlh^E) > k}. 
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Moreover, each non-empty irreducible component o/ iy^(r; ci, C2) has dimension greater 
or equal to 

pUr; ci, C2) = dim(MH) - k{k - r(l + P„(X)) + ^ - | + ^2) 

and Vr^+^(r;ci,C2) C S'm5f(py^(r; Ci, C2)) whenever W^{r; Ci, C2) ^ Mx,H{r; 01,02) ■ 

Proof. First of all notice that for any E G Mh, the numerical condition ci{E)H > rKxH 
implies that H'^{E) = 0. Indeed, by Serre duality we have: 

H\E) = H\E*{Kx)) 

and since E is an if -stable vector bundle on X, E* is also if -stable. Thus, if H'^[E) ^ 0, 
Ox{-Kx) "-^ E* and since E* is ii-stable we get 

which contradicts the assumption ci{E)H > rKxH . Hence the result follows from The- 
orem 12.31 and the fact that by the Riemann-Roch theorem 

X(r; ci, 02) = r(l + P,(X)) - ^ + | - C2. 

D 

For any sheaf E on P^, denote by x"*" = X~^{E) '■= max{x(ii^), 0}. In [TT], Gottsche and 
Hirschowitz gave, under the assumption ci > — 3r, a lower bound for the codimension of 
the Brill-Noether loci W^ """^(r; ci, C2) of rank r, stable vector bundles E on P^ with fixed 
Chern classes Oi{E) = Ci such that h^{E) > x"*" + 1. From the previous result we get the 
following upper bound: 

Corollary 2.9. Let W^ ^^{r; 01,02) be the Brill-Noether locus of rank r, stable vector 
bundles E on P^ with fixed Chern classes Oi{E) = Ci such that h^{E) > %+ + 1. Assume 
that c\ > — 3r. Then, the following holds: 

(a) Ifx^ = Xij] oi, 02) > 

2 < codim(iy^^+^(r; Ci, C2)) < x{r; Ci, 02) + 1. 

(b) ifx^ = x(^;ci,C2) = 

codim(iy^ +^(r;ci,C2)) = 1. 

(c) lfx'^ = 0> xir; 01,02) 

codim(Vr^^+^(r; a, C2)) < (x+ + l)(x+ + 1 - x(r; Ci, 02)). 

Proof. The lower bounds follow from [llj; Theorem 1. Since ifp2 = (9p2(— 3), the hy- 
pothesis ci > — 3r is equivalent to oi{E)H > rKxH and the upper bounds follow from 
Corollary EH D 
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In subsequent sections we will see that there are plenty of situations where the as- 
sumptions of Theorem 12.31 are satisfied and we will prove that in several of them the 
Brill-Noether loci have exactly the expected dimension, showing that the bound given in 
Theorem 12.31 is sharp. 

Once we have proved the existence of these varieties, it is natural to ask whether the 
condition p^{r; Ci, ■ ■ ■ , c^) < implies that the variety Wj^{r; Ci, ■ ■ ■ , Cg) is empty and 
whether the condition p'l[{r; Ci, ■ ■ ■ , c^) > implies that the variety W^{r; Ci, ■ ■ ■ , Cg) is 
non-empty. Indeed we are led to pose the following three questions. 

Question 2.10. Let X be a smooth projective variety of dimension n. We consider a 
moduli space Mnir; ci, ■ ■ ■ , c^) of rank r, if -stable vector bundles on X where the Brill- 
Noether locus is defined. 

(1) Whether p^(r; Ci, ■ ■ ■ , c^) < implies Vr^(r; Ci, ■ ■ ■ , c^) = ? 

(2) Whether p^(r; ci, ■ ■ ■ , Cs) > implies W^ir; ci, ■ ■ ■ , c.,) 7^ ? 

(3) Whether p^(r; Ci, ■ ■ ■ , c^) > and Wff{r; Ci, ■ ■ ■ , c^) 7^ implies 

p%{r;ci,--- ,Cs) =dimiy^(r;ci,--- , c^) ? 

If C is a smooth algebraic curve and the moduli space is the Picard variety Pic'^{C) of 
degree d line bundles on C, the answer to Question 12.101 is well-known. In fact, classical 
Brill-Noether theory has its roots dating more than a century ago and it is concerned with 
the subvarieties of the Picard variety Pic'^{C) determined by degree d line bundles on C 
having at least a specified number of independent sections. Basic questions, concerning 
non-emptiness, connectedness, irreducibility, dimension, singularities, cohomology classes, 
etc ... have been completely answered when the underlying curve is a generic curve in 
the moduli space Mg of curves of genus g. Indeed, the Brill-Noether locus is non-empty if 
p > and connected if p > 0. For a generic curve in Mg, the Brill-Noether locus is empty 
if p < and is irreducible of dimension p if p > 0. Modern proofs of these results have 
been given by Kempf, Kleiman and Laksov, Fulton and Lazarsfeld, Griffiths and Harris, 
and Gieseker and a full treatment of this is contained in ^]. The Brill-Noether loci in the 
moduli space of vector bundles of higher rank on a generic curve C has been studied by 
Teixidor and others in a series of papers in 1994-2007. 

Next example shows that if we deal with algebraic varieties of dimension greater than 
one. Question 12. 101 (1) is no longer true; it gives an example of negative generalized Brill- 
Noether number and the corresponding Brill-Noether locus is non-empty, in contrast with 
the classical case. Even more, we give examples where the expected dimension of the Brill- 
Noether locus and the dimension of the Brill-Noether locus do not coincide in spite of 
being positive the generalized Brill-Noether number. Indeed, we have 

Example 2.11. Let X = P^ x P^ be a quadric surface in P^. We denote by /i, I2 the 
generators of Pic{X) and for any integer n > 2 we fix the ample line bundle L = li + nl2. 
We will describe the Brill-Noether stratification of Mx,l(2; (2n — l)/2,2n). Indeed, since 
{2n — l)/2-^ = 2n — 1 > —An — 4 = 2KxL, its existence is guaranteed by Corollary 12. 81 Let 
us now prove that for any integer n > 2 and any integer j, < j < n, the Brill-Noether 
locus Wl{2; (2n — 1)^2, 2n) is non-empty. To this end, we consider JF the irreducible family 
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parameterizing rank two vector bundles E on X given by an exact sequence 

(2.2) 0^Ox^E^Ox{{2n~l)l2)®Iz^0 

where Z is a locally complete intersection 0-dimensional scheme of length 2n such that 
H^Iz{{2n -l)k) = 0. 

Notice that since \Z\ = 2n and h^Ox{{2n — l)^) = 2n, the condition 

H'lzii2n - l)l2) = 

is satisfied for all generic Z G Hilb'^"'{X) and JF is non-empty. In addition, it can be seen 
that dim J^ = 4(2n) - 3 and that J^ --> Mx,l(2; (2n - l)/2, 2n) (see [9J; Proposition 4.6). 

Claim 1: Wl{2; {2n - l)/2, 2n) = T. 

Proof of Claim 1: Any E ^ T is L-stable and since H^Iz{i2n — l)l2) = 0, we have 
h^{E) = 1. Thus JF c Wl{2] (2n — 1)^2, 2n). Let us prove the converse. We take a vector 
bundle E G Wl{2; {2n — l)/2, 2n) and a non-zero global section s of E. We denote by Y 
its scheme of zeros and by D the maximal effective divisor contained in Y. Then s can 
be regarded as a section of E{—D) and its scheme of zeros has codimension > 2. Thus, 
for some effective divisor D = ali + 6/2 we have a short exact sequence 

(2.3) -^ Ox{D) ^ E ^ Ox{{2n - 1)^2 - D) Iz ^ 

where Z is a locally complete intersection 0-cycle. Since D is effective, a,b > and by 
the L-stability of E we have 

{ah + hl2)L = {an + b) < = ^ ^ . 

Therefore, a = b = and in fact E & T. 

It follows from Claim 1 that the Brill-Noether locus Wl{2] {2n—l)l2, 2n) is an irreducible 
variety of dimension 8n — 3 and notice that in this case, its dimension coincides with the 
expected one. Indeed, 

p\{2- {2n - l)/2, 2n) = dim Mx,l(2; {2n - l)l2, 2n) - 1(1 - x(2; (2n - l)/2, 2n)) 

= 8n-3 

since by Riemann-Roch theorem, 

. X . . ^, ^ ((2n-l)/2)(2/i + 2/2) ((2n-l)/2)^ 

(2.4) x(2; {2n - l)l2, 2n) = 2 + ^ ' ^^^ ' ^' + ^ ^-^^^ - 2n = 1. 

For any i, l<z<r7, — 1, we can choose a 0-dimensional scheme Zi on X of length 2n 
such that h^{IzX{2n - 1)12)) = i and h^{IzX{2n - i - l)^)) = 0. Thus, if we denote by 
Ei the rank two vector bundle on X given by the exact sequence 

(2.5) O^Ox^E,^Ox{{2n-l)l2)0lz,^O 
we have h^{Ei) = i + 1. 

Claim 2: Ei is L-stable. 

Proof of Claim 2: Since Ei is given by a non-trivial extension 

(2.6) Q^Ox^E,^ Ox{{2n - l^) ® Iz, ^ 0, 
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given a sub-line bundle Oxi^h + ^^2) of Ei we have two possible cases: 

(1) Ox{ah + bl2)^Ox 

(2) Oxiah + bk) -^ Oxii2n - l)^) ® Iz,- 

In case (1), {ah + 6/2)^ < < ^ = ^i^^. In case (2), -a/i + (2n - 1 - b)l2 is an 
effective divisor and hence a < and b < 2n — 1. On the other hand, since 

H^Oxiah + ib- i)l2)) C H\lzX{2n - i - \)h)) = 

we have a < or 6 < z. If 6 < i, since a < and z < n — 1, we have 

{ah + bl2)L = an + b<n-l< = ^ ^ . 

Assume a < 0. In that case, since 6 < 2n — 1 we get 

/ , ,, N. , , 2n-l Ci(Ei)L 
{ah + bl2)L = an + b<-n + b<n-l< = ^ ^ . 

Therefore, Ei is L-stable which proves Claim 2. 

By Claim 2, Ei G W}^^{2; {2n — l)/2, 2?t,) and we get a chain of non-empty Brill-Noether 
loci 

Mx,l(2; (2n-l)/2,2n) D 1^2(2; (2n-l)/2,2n) D iy|(2; (2r2-l)/2,2n) D •■ ■ 

■■■ Diyr(2;(2r2-l)/2,2n) D 0. 

Notice that for any k, 1 < k < n, such that 8n — 3 < /i;(A; — 1) the Brill-Noether locus 
Wj^{2; {2n — l)/2, 2n) is non-empty and the generalized Brill-Noether number, p^(2; {2n — 
l)l2,2n), is negative. In fact, 

pi{2; {2n - l)/2, 2n) = dim Mx.l(2; (2n - l)/2, 2n) - k{k - x{2; {2n - l)h, 2n)) 

= 8n-3-k{k-l) 

where the last equality follows from Proposition 13.61 and the equation (12. 4p . 

Finally, we have that for any k such that 2 < k{k — 1) < 8n — 3, the generalized 
Brill-Noether number, p|(2; {2n — l)/2,2n), is positive; however, the Brill-Noether locus 
Wl{2; {2n — l)/2, 2n) is non-empty and its dimension is greater than the expected one. In 
fact, it is enough to observe that 

dimiy^(2;(2n-l)Z2,2n) = 8n - 2k - 1 > p^(2; (2n - l)/2, 2n). 

3. Brill-Noether loci and change of polarizations 

In this section we will see that the Brill-Noether stratification allow us to compare 
moduli spaces of vector bundles on smooth projective surfaces, stable with respect to 
different polarizations. 

Let X be a smooth projective variety of dimension n. As we pointed out in Remark 



12. 2[ the notion of stability of vector bundles on X strongly depends on the ample divisor. 
Hence it is natural to consider the following interesting problem: 
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Problem 3.1. What is the difference between the moduh spaces 

Mh = Mx,H{r; Ci, ■ ■ ■ , Cmin{r,n}) and Ml = Mx,L{r; Ci, ■ ■ ■ , Cmin{r,n}) 

where H and L are two different polarizations? 

It turns out that the ample cone of X has a chamber structure such that the moduli 
space Mx,H{r] Ci, ■ ■ ■ , Cmin{r,n}) ouly dcpcuds on the chamber of H and the problem con- 
sists on determining how the moduli space changes when the polarization crosses a wall 
between two chambers (see Definition I3.2p . These changes have been explicitly described 
in very few occasions (see for instance [B], [5], [H]). 

We will focus our attention in case where X is a Hirzebruch surface and we will deal 
with stable rank two vector bundles on X. Very surprisingly we will realize that in a 
huge family of moduli spaces, the difference between two moduli spaces Mx,(2; ci, C2) and 
Mh{2; Ci, C2) (where L and H are two polarizations sitting in chambers sharing a common 
wall), is precisely described by suitable Brill- Noether loci. Moreover, we will be able to 
compute the dimension of these Brill-Noether loci and we will prove that the expected 
dimension of these Brill-Noether loci is indeed the dimension. 

To start with, let us recall the basic results about walls and chambers due to Qin ([19j). 

Definition 3.2. (i) Let ^ E Num{X) (g) M. We define 

>V« := Cxnixe Num{X) O R\x^ = 0}. 

(ii) Define W(ci,C2) as the set whose elements consist of W^, where ^ is the numerical 
equivalence class of a divisor D on X such that Ox{D + ci) is divisible by 2 in Pic{X), 
and that 

for some locally complete intersection codimension-two cycle Z in X. 

(iii) A wall of type (ci,C2) is an element in W(ci,C2). A chamber of type (ci,C2) is a 

connected component of Cx \ VV(ci, C2). A Z-chamber of type (ci, C2) is the intersection 

of Num{X) with some chamber of type (ci, C2). 

(iv) A face of type (ci, C2) is F = W^ fl C, where W^ is a wall of type (ci, C2) and C is a 

chamber of type (ci, C2). 

We say that a wall W^ of type (ci, C2) separates two polarizations L and L' if, and only 
if, ^L < < ^L'. 

Remark 3.3. In [19j; Corollary 2.2.2 and Remark 2.2.6, Qin proves that the moduli space 
Mx,l(2; Ci, C2) only depends on the chamber of L and that the study of moduh spaces 
of rank two vector bundles stable with respect to a polarization lying on walls may be 
reduced to the study of moduli spaces of rank two vector bundles stable with respect to 
a polarization lying on Z-chambers. 
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Definition 3.4. Let ^ be a numerical equivalence class defining a wall of type (ci,C2). 
We define S^{ci,C2) as the quasi-projective variety parameterizing rank 2 vector bundles 
E on X given by an extension 

^ Ox{D) ^E^ Ox{ci -D)®Iz^O 

where D is a divisor with 2D — ci = ^ and Z is a locally complete intersection 0-cycle of 
length C2 + (^^ — c^)/4. Moreover, we require that E is not given by the trivial extension 
when C^ = c^ — 4c2. 



Remark 3.5. By [19j; Theorem 1.2.5, if Li and L2 are two ample divisors on X and 
ii^ is a rank 2 vector bundle on X which is Li-stable but L2-unstable, then we have 
E G S^{ci, C2) where C, defines a non-empty wall of type (ci, C2) separating Li and L2 (i.e. 
^Li < < ^L2; moreover, we can consider the ample divisor L := {^L2)Li — (^Li)L2 on 
X and we have L^ = 0). More can be said, by [19]; Theorem 1.3.3, given Li and L2 two 
polarizations lying on chambers Ci and C2, sharing a common wall, we have 

(3.1) Ml,(2;ci,C2) = (Mi,(2;ci,C2)\U5^5(ci,C2))U(U5f_5(ci,C2)), 

where ^ satisfies ^Li > and runs over all numerical equivalence classes which define the 
common wall W. 

In the next result, we have summarized well-known properties of some moduli spaces 
of stable rank two vector bundles on projective surfaces that we will need later on (see 
for instance [6]; Proposition 3.11). 

Proposition 3.6. Let X be a smooth, projective rational surface with effective anti- 
canonical line bundle and let H be an ample line bundle on X. Then, the moduli space 
Mx._H"(2; Ci, C2) of rank two, H-stable vector bundles E on X with fixed Chern classes 
Ci{E) = Ci is either empty or a smooth irreducible variety of dimension 

dim Mx,h{2; Ci, C2) = 4c2 -0^-3. 

For any integer e > 0, let X = Fe = P((9pi © Of>i{—e)) be a non singular, Hirzebruch 
surface. We denote by Cq and F the standard basis of Pic{X) = Z©Z such that Cq = — e, 
F^ = and CqF = 1. The canonical divisor is given by 

Kx = -2Co-{e + 2)F 

and it is well known that a divisor L = qCq + bF on X is ample if, and only if, it is very 
ample, if and only if , a > and b > ae, and that D = a'Co + b'F is effective if and only 
if a' > and 6' > ([12]; V, Corollary 2.18). 

Given an integer C2 > and a G {0, 1}, we denote by Ml{2] Cq + aF, C2) the moduli 
space of rank two, L-stable vector bundles E on X with fixed Chern classes Ci{E) = 
Cq + aF and C2{E) = C2- For any integer ra, 1 < n < C2 — 1, consider the following ample 
divisor on X 

L„ := Co + {e + 2c2-a-2n + 1)F. 
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Notice that the equivalence class 

a := Co - (2c2 -a- 2n)F 

defines a non-empty wall W^" of type (Co + «-F, C2) which separates the ample divisors 
Ln and Ln+i- Indeed, ■Cn = ~e ~ 2(2c2 — a — 2n) < 0, .^„ + ci = 2(Co — (c2 — a — n)F) is 
divisible by two in Pic{X), C2 + ^^ ^ = n > and 

-^n+l'Cn = — 1 < < 1 = -L„^„. 

We are led to pose the following problem 

Problem 3.7. Determine the difference between the moduli spaces 

Mi„(2;Co + aF,C2) and Ml„^,(2; Co + aF, C2). 



Remark 3.8. Given an ample line bundle L = qCq + 6F on X, we can represent L as 
a point of coordinates (a, h) in the plane. The following picture gives us an idea of the 
situation we are discussing: 




Next result completely solves this problem. We are going to prove that these differences 
are surprisingly controlled by the following two Brill-Noether loci: 

W^2^^^(2;ci,n)cMi„^,(2;ci,n) and iy2„(2; c~i,n) C Mi„(2; Ci,n) 

where Ci = —Co + (2c2 — a — 2n)F and Ci = Co + (a + 2n — 2c2)-F. 



Theorem 3.9. Let X = F^ be a smooth Hirzebruch surface, C2 > 1 an integer and 
a G {0,1}. For any integer n, 1 < n < C2 — 1, consider the ample divisor Ln '■= 
Co + (e + 2c2 - a - 2n + 1)F. Then 



n 
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Moreover, the Brill-Noether loci 

Wl^^^{2;c^,n) C Mi„^,(2; cl, n) and Wlj2;c\,n) C M,.„(2;ci,n) 
do have the expected dimension p\ (2;ci,n) and p\ (2;ci,n), respectively. 
Proof. We have already seen that the numerical class 

in ■■= Co - (2c2 - a - 2n)F 
defines a non-empty wall W^" of type (Co + aF., C2) which separates the ample divisors 

L„ = Co + (e + 2c2 - a - 2n + 1)F and L„+i = Cq + (e + 2c2 - a - 2ra - 1)F. 
Hence, by Remark 13.51 we have: 

(3.2) Mi„(2; Co + aF, C2) = (Ml„^,(2; Co + aF, C2) \ Ug^5(ci, C2)) U {U^£-^{ci, C2)), 

where ^ satisfies ^L„ > and runs over all numerical equivalence classes which define the 

common wall W^" separating L„ and Ln+i- 

Claim 1: ^n is the only equivalence class which defines the common wall W^" and verifies 

Proof of Claim 1: Let L = aCo + bF & W^" be an ample divisor lying on the common 
wall defined by (,„,- By definition, 

= L^n = — oe — a(2c2 — a — 2n) + b 

and thus L = oCq + a(2c2 — a — 2n + e). Assume there exists a numerical equivalence 
class C, = aCo + 7F defining the common wall W^" and such that ^L„ > 0. In particular, 
since L = Co + (2c2 — a — 2n + e) G W^" , we have 

= ^L = (aCo + 7F)(Co + (2c2 - a - 2n + e)F) = -ae + o{2ci - a - 2n + e) + 7 

and hence 7 = — o"(2c2 — a — 2n). On the other hand, since ^ defines a non-empty wall 

< C2 + ^^ = C2 - y (2C2 - a - 2n) + -(1 - cr') - - 

which gives us a = ±1. Finally, ^L,„ > implies a = 1 and thus ^ = Co — (2c2— a— 2n)F = 
in which proves Claim 1. 

Applying Claim 1, equation (13. 2p turns out to be 

(3.3) Mi„(2; Co + aF, C2) = (Mi„+,(2; Co + aF, C2) \ %(ci, C2)) U £^^„{cu c^). 

Notice that 

CiL„ = (Co + (a + 2n - 2c2)F)(Co + (e + 2c2 - a - 2n + 1)F) 
= 1 

> 2(-4c2 + 4ra + 2a - e - 4) 

= 2(-2Co - (e + 2)F)(Co + (e + 2c2 - a - 2n + 1)F) 
= 2KxLn 
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and 

CiL„+i = (-Co + (2c2 -a- 2n)F){Co + (e + 2c2 - a - 2n - 1)F) 
= 1 

> 2(-4c2 + An + 2a-e) 

= 2(-2Co - (e + 2)F)(Co + (e + 2c2 - a - 2n - 1)F) 
= 2KxLn+i. 

Thus by Corollary 12.81 the Brill-Noether stratification of the moduli spaces ML„{2]Ci,n) 
and Mi^^-^(2; ci,n) are defined. 
Claim 2: We have: 

(a) £:_5„-iy^j2;c~i,n), 

(6) f5„-iy2„^^(2;ci,n). 

Proof of Claim 2: First of all notice that Claim 2 is, by definition, equivalent to have 

(a') ^_g„ = {G G Mi„(2;Co + «F,C2)|/i°(G(-(c2 -n)F)) > 0}, 

{b') S^„ = {Ge Mi„^,(2; Co + aF, C2)|/i°(C(-Co + (c2 - n - a)F)) > 0}. 

Let us prove (a'), li E ^ ^-^ni then i? is given by a non-trivial extension 

^ Ox((c2 - n)F) ^E^ Ox(Co - (c2 - n - a)F) ® /^ ^ 

where Z is a 0-dimensional scheme of length \Z\ = C2{E{—{c2 — n)F)) = n. Therefore 
/i°(E(-(c2 - n)F)) > 0. Moreover, it follows from (USD that £_^„ C Mi„(2; Co + aF, C2). 
Now let us see the converse. Let E e {G e Ml„{2; Cq + aF, C2)|/i°(C(-(c2 - n)F)) > 0} 
and we are going to see that E G ^-5„- Let s be a non-zero section of E{—{c2 — n)F) 
and let Y be its scheme of zeros. Let D be the maximal effective divisor contained in Y . 
Then s can be regarded as a section of E{—{c2 — n)F — D) and its scheme of zeros has 
codimension > 2. Thus, for some effective divisor D = aCo + hF we have a short exact 
sequence 

-^ Cx((c2 -n)F + D)^E^ Ox{Cq - (c2 - n - a)F -D)®Iz^O. 

By assumption, E is L„-stable. Therefore, 

((C2 - n)F + D)Ln < ^ = ^ , 

which is equivalent to a(2c2 — a — 2n + l) + h < 0. Since D is an effective divisor a, 6 > 
and hence the only solution is a = 6 = 0. Therefore D = and E is given by the exact 
sequence 

-. Ox{{c2 - n)F) ^E^ Ox{Co - (c2 - n - a)F) ^ Iz ^ 

which proves that E G ^-g„- 

Let us now prove (b'). By Remark (13.31) . S^„ C Mi^^-^(2;Co + aF, C2) and since any 
E G S^„ is given by a non-trivial extension of type 

-> Cx(Co - (C2 - n - a)F) ^ F ^ Cx((c2 - n)F) ® /^ ^ 0, 

for any F G £^„, we have /i°(F(— Co + (c2 — n — a)F)) > 0. Conversely, given 

EE{Ge Mi„+,(2; Co + aF, C2)|/i°(G(-Co + (c2 - n - a)F)) > 0} 



16 L. COSTA, R.M. MIRO-ROIG 

we are going to see that E G S^„. Let s be a non-zero section of E{—Co + (c2 — n — a)F) 
and let Y be its scheme of zeros. Let D be the maximal effective divisor contained in 
Y. Then s can be regarded as a section of E{—Cq + (c2 — n — q)F — D) and its scheme 
of zeros has codimension > 2. Thus, for some effective divisor D = aCo + bF we have a 
short exact sequence 

^ Ox{Co -{c2-n-a)F + D)^E^ Ox{{c2 - n)F -D)®Iz^O. 

By assumption, E is L„+i-stable. Therefore, 

/^ / \j^ , n\T ^ ci{E)Ln+i (Co + aF)L„+i 
[Co - (C2 - n - a}F + D}Ln+i < = , 

which is equivalent to a(2c2 — a — 2n — 1) + b < 0. Since D is an effective divisor this 
implies that a = b = and thus E is given by the exact sequence 

^ OxiCo - (C2 - n - a)F) ^E^ Ox{{c2 - n)F) ® J^ ^ 

which proves that E G S^^. 

Putting together Claim 2 and (13.31) we obtain 

Mi„(2;Co + «F,C2) = (Mi„^,(2;Co + aF,C2)\W^i„^^(2;ci,n))UW^i,^(2;d-i,n). 

Finally let us see that the dimensions of the Brill-Noether loci Wl^{2; ci, n) and Wl (2; Ci, n) 
coincide with the expected one. To this end, by Claim 2, it suffices to prove that 

(i) dim(£_5J = p^j2;c~i,n), 

(m) dim{S^J = pi„^^(2; Ci,n). 
By construction, 

dim£:_5„ = ext\Iz{Co - {c2 - n - a)F), Ox{{c2 - n)F)) + 2\Z\ - h'>E{-{c2 - n)F) 
= h\Iz{-CQ - (2c2 -2n-a + e + 2)F)) + 2\Z\ - h^E{-{c2 - n)F) 

being E G 8-^^. Since h\Ox{-Co - (2c2 -2n-a + e + 2)F)) = 0, for i = 0,l, from the 
cohomological exact sequence associated to 

^ Iz{-Co - (2c2 -2n-a + e + 2)F) -^ Cx(-Co - (2c2 -2n-a + e + 2)F) 

-^ Oz{-Cq - (2c2 -2n-a + e + 2)F) -^ 
we deduce that 
h\lz{-Co - (2c2 -2n-a + e + 2)F)) = /i°(C^(-Co - (2c2 -2n-a + e + 2)F)) = \Z\. 

For any E G ^-5„, we have /i°£'(— (c2 — n)F) = 1 and C2(-E'(— (c2 — n)F)) = n = \Z\. 
Putting altogether we get 

dim£^„^^ = 3r7, — 1. 
On the other hand, by Riemann-Roch theorem, 

X(2;ci,n) = 2 + ('--^)(^^o+(e+2)F) ^ (^ 



^2 
— n 



2 I (Co + (a+2n-2c2)F)(2Co+(e+2)F) (Co + (a+2n-2c2)J')^ _^ 

3r2 — 4c2 + 2q; — e + 3, 



BRILL-NOETHER THEORY FOR MODULI SPACES 17 

and by Proposition 13.61 dim Mt.^^ (2: ci,n) = 4c2 — (2a; — e) — 3. Therefore, 

pij2; c~i, n) = dim Mi„(2; c~i, n) - 1(1 - x(2, Ci, n)) = 3r2 - 1 

which proves {i). 

Let us now prove {ii). By construction, 

dim£5„ = ea;tn/z((c2 - n)^), Ox{Cq - (c2 - n - a)F) + 2|Z| - hPE^-C^ + (ca - n - a)F) 
= h\Iz{-^CQ + (2c2 - 2n - a - e - 2)F)) + 2|Z| - h^E{-Co + (ca - n - a)F) 

being E e ^5„. Since h'{Ox{-SCo + (2c2 - 2n - a - e - 2)F)) = 0, for i = 0,2, 
h\Ox{-3Co + {2c2-2n-a-e-2)F)) = -x(Cx(-3Co + (2c2-2n-a-e-2)F)) = -x 
and by Riemann-Roch theorem 

= 11 (-3Co+(2c2-2n-a-e-2)F)(2Co+(e+2)F) (-3Co+(2c2-2n-a-e-2)F)^ 

A -'- ~r 2 2 

= 4c2 - 4r2 - 2a - 2 + e. 
From the cohomological exact sequence associated to 

-^ Izi-SCo + (2c2 - 2n - a - e - 2)F) -^ Cx(-3Co + (2c2 - 2n - a - e - 2)F) 

^ Cz(-3Co + (2c2 - 2n - a - e - 2)F) ^ 
we deduce that 
h\Izi-SCo + (2c2 - 2n - a - e - 2)F)) = /i°(Cz(-Co - (2c2 - 2n - a + e + 2)F)) 

+/ii(Cx(-3Co + (2c2 - 2n - a - e - 2)F)) 
= |Z| + 4c2 - 4n - 2a - 2 + e. 

For any E G £^^, we have /i°£^(— Co + (c2 — n — a)F) = 1 and C2(-E'(— Co + (c2 — n — a)F) = 
n = \Z\. Putting altogether we get 

dim S^^ = 4c2 — n + e — 2a — 3. 

On the other hand, by Riemann-Roch theorem, 

and by Proposition 13.61 dim Mr,^ (2: Ci,n) = 4c2 — (2a — e) — 3. Thus, 

pL+i(2;ci,n) = dimML„_^^(2;ci,n) - 1(1 -x(2;ci,n)) = 4c2 - n + e - 2a - 3 
which proves (ii). D 

4. Brill-Noether loci and Instanton bundles 

In this section, we will address the three problems posed in section two for the case 
of mathematical instanton bundles on P^. More precisely, we will prove that the Brill- 
Noether locus of instanton bundles on P^ is non-empty if and only if the corresponding 
generalized Brill-Noether number is non-negative and in this case the Brill-Noether locus 
is a smooth irreducible variety of the expected dimension. 

Let MI{n) be the moduli space of mathematical instanton bundles E over P^ with 
Ci{E) = 2 and C2{E) = n and verifying the instanton condition H^{E{—?))) = 0. It 
is known that MI{n) is non-singular and irreducible for n < 6 (see [2] for n = 2, |13| 
for n = 3, [lOj for n = 4, [3] and [T7] for n = 5 and [5] for n = 6) and it has been 



18 L. COSTA, R.M. MIRO-ROIG 

conjectured that MI{n) is non-singular and irreducible. The only known component 
MIqIu) of MI[n) is the one made of vector bundles which are generalizations of (a twist 
of) the ones associated to n + 1 skew lines in P^ ('t Hooft bundles) and we know that 
MIo{n) is a generically smooth variety of dimension Sn — 11. 

Since for any instanton bundle E G MIo{n), we have H^{F^, E) = for z > 2, Theorem 
12.31 applies and the Brill- Noether stratification of MIo{n) is well defined. So, for any 
k > 1, we can study the Brill- Noether loci 

W'' := {E G MIo{n)\h^{E) > k} C MJo(n). 

We have: 

Proposition 4.1. Assume n > 13. With the above notations we have 

(i) W'' 7^ ^ if and only if p^{2] 2, n) > if and only if k <3. 

(ii) W^ is a smooth rational irreducible quasi-projective variety of the expected dimen- 
sion 5n — 1. 
(iii) W"^ is a smooth rational irreducible quasi-projective variety of the expected dimen- 
sion 2n -f- 7. 

Proof, (i) Let us first compute p''{2; 2, n). To this end, we take E a mathematical instanton 
bundle with Chern classes {ci{E) , C2{E)) = (2,n). It is well-known that £'(—1) is the 
cohomology bundle of a monad of the following type 

^ Cp3(-l)"-i^^02^^C'p3(l)"-i ^ 0. 

Hence we have two exact sequences 

— * /C = ker(/?) ^ 0^?^0p3(l)"-i -^ 0, 

and 

— > Op3(-l)"-i^^/C ^ E{-1) — > 

which allows us to compute x{E)- Indeed, 

X{E) = x(/C(l)) -{n-l) = 2nx(Op3(l)) - {n - l)x(Op3(2)) - {n - 1) = -3n + 11. 

Since dimM/o(r2) = 8n — 11, we deduce that 

p'=(2;2,n) = dim M loin) - k{k - x{E)) 
= 8n-ll-k{k + 3n-ll) 
= n{8 - 3k) + k{ll - k) -11. 

So, p\2;2,n) = 5n-l, p'^{2;2,n) = 2n + 7 and p'' (2; 2 , n) < ioi k > 3 provided n > 14. 
By a result in [1], for any E G MIo{n), h^{E) < 2. On the other hand, any instanton 
bundle E associated to n + 1 general skew lines in P^ satisfies h^{E) = 1 ('t Hooft bundles) 
and any instanton bundle E associated to n + 1 skew lines on a smooth quadric Q in P^ 
satisfies h^{E) = 2 (special 't Hooft bundles). Putting altogether we have W'' 7^ if and 
only ii k <2, if and only if p''{2; 2, n) > 0. 

(ii) and (iii) The expected dimensions are p^(2; 2,n) = 5n — 1 and p^(2; 2, n) = 2n + 7. 
Hence, the results follows from the fact that W'^ (resp. W"^) is nothing but the variety 
of 't Hooft bundles (resp. special ' t Hooft bundles) and we well-known that the variety 
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of 't Hooft bundles (resp. special ' t Hooft bundles) is a smooth, irreducible and rational 
variety of dimension 5n — 1 (resp. 2n + 7). 

D 
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